Multi-Instance GPU

NVIDIA Multi-Instance GPU User Guide r570 documentation

MIG-GPU简介与A100-MIG实践详解 - 知乎

Compute Instance

Combining Memory and First Compute Slice

Compute Instance可以几个lanes的共享一块SM

image-20250407095858639

MPS带宽有隔离，MIG带宽有隔离

MIG用不了PCIe和NVLink

CUDA MPS is supported on top of MIG. The only limitation is that the maximum number of clients (48) is lowered proportionally to the Compute Instance size.

NVIDIA Multi-Instance GPU and NVIDIA Virtual Compute Server

results matching ""

    No results matching ""